Degenerate Stochastic Control Problems with ExponentialCosts and Weakly Coupled Dynamics: Viscosity Solutions and a Maximum Principle

نویسندگان

  • Minyi Huang
  • Peter E. Caines
  • Roland P. Malhamé
چکیده

This paper considers a class of optimization problems arising in wireless communication systems. We analyze the optimal control and the associated Hamilton–Jacobi–Bellman (HJB) equations. It turns out that the value function is a unique viscosity solution of the HJB equation in a certain function class. To deal with the fast growth condition of the value function in establishing uniqueness, we construct particular semiconvex/semiconcave approximations for the viscosity sub/supersolutions, and obtain a maximum principle on unbounded domains. The localized envelope function technique introduced in this paper permits an analysis of the uniqueness of viscosity solutions defined on unbounded domains in cases with very general growth conditions when combined with appropriate system dynamics. The optimization problem with state constraints is also considered.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Se p 20 05 On some recent aspects of stochastic control theory and their applications ∗

This paper is a survey on some recent aspects and developments in stochastic control theory. We discuss the two main historical approaches, Bellman’s optimality principle and Pontryagin’s maximum principle, and their modern exposition with viscosity solutions and backward stochastic differential equations. Some original proofs are presented in a unifying context including degenerate singular co...

متن کامل

2 00 5 On some recent aspects of stochastic control and their applications ∗

This paper is a survey on some recent aspects and developments in stochastic control. We discuss the two main historical approaches, Bellman’s optimality principle and Pontryagin’s maximum principle, and their modern exposition with viscosity solutions and backward stochastic differential equations. Some original proofs are presented in a unifying context including degenerate singular control p...

متن کامل

Gradient bounds for nonlinear degenerate parabolic equations and application to large time behavior of systems

We obtain new oscillation and gradient bounds for the viscosity solutions of fully nonlinear degenerate elliptic equations where the Hamiltonian is a sum of a sublinear and a superlinear part in the sense of Barles and Souganidis (2001). We use these bounds to study the asymptotic behavior of weakly coupled systems of fully nonlinear parabolic equations. Our results apply to some “asymmetric sy...

متن کامل

Numerical Solution of Weakly Singular Ito-Volterra Integral Equations via Operational Matrix Method based on Euler Polynomials

Introduction Many problems which appear in different sciences such as physics, engineering, biology, applied mathematics and different branches can be modeled by using deterministic integral equations. Weakly singular integral equation is one of the principle type of integral equations which was introduced by Abel for the first time. These problems are often dependent on a noise source which a...

متن کامل

Optimal Control of Nonlinear Systems with Controlled Transitions

This paper studies the optimum stochastic control problem with piecewise deterministic dynamics. The controls enter through the system dynamics as well as the transitions for the underlying Markov chain process, and are allowed to depend on both the continuous state and the current state of the Markov chain. The paper shows that the feedback optimal control relies on the viscosity solutions of ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • SIAM J. Control and Optimization

دوره 44  شماره 

صفحات  -

تاریخ انتشار 2005